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Abstract. We consider a finite chain of non-linear oscillators coupled at its ends to two infinite heat 
baths which are at different temperatures. Using our earlier results about the existence of a stationary 
state, we show rigorously that for arbitrary temperature differences and arbitrary couplings, such a system 
has a unique stationary state. (This extends our earlier results for small temperature differences.) In all 
these cases, any initial state will converge (at an unknown rate) to the stationary state. We show that this 
stationary state continually produces entropy. The rate of entropy production is strictly negative when the 
temperatures are unequal and is proportional to the mean energy flux through the system. 



V 

§ ■ 1. Introduction 

In a recent paper, [EPR], we have studied the existence of a stationary regime in a non-linear non- 
equilibrium setup. The model considered was that of a chain of n non-linear oscillators coupled 
at each of its two ends to heat baths which are infinite systems at two different temperatures. 
Under suitable conditions which we sketch below, it has been shown that for sufficiently small 
temperature differences between the baths, the complete system has a unique stationary state, 
and that every initial state converges to it. Of course, this stationary state is not an equilibrium 
state but a steady state in which supposedly heat flows (on average) from the hot bath to the 
cold one. The aim of this paper is to show first that this result extends to arbitrary temperature 
differences and that the heat flux across the chain is positive. 

It should be noted that this is not aperturbative result. To prove the existence and uniqueness 
of the steady state for non-linear, boundary driven problems with arbitrary temperature difference 
is a difficult problem. See [GLP] and [GKI] for similar results for a gas of particles in a box 
with thermostatting boundary conditions. For other boundary driven models, see [FGS] (a 
1 -dimensional hard-core gas). 
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Our model, whose study was started in [EPR], combines several desirable features, while 
still allowing for a rather complete set of rigorous results. The main features are the property 
of being fully Hamiltonian (as those studied in [FGS] and [SL]), with non-linear interactions, 
and a realistic implementation of the retro-action of the chain on the heat baths. In particular, 
the system is self-regulating and we do not need any Gaussian thermostats [PH, EM, H, CELS, 
GC1, GC2, G]. 

The reader should note that in our model the energy of the chain fluctuates wildly in time 
and there is no external dissipation term which prevents the energy of the chain from diverging 
to infinity. The baths can exchange energy with the chain. Also, since the potentials are not 
monotone, several stationary non-equilibrium states could possibly exist, each corresponding 
for example to one of the extrema of the potential. We show here that on the contrary, there is 
exactly one stationary state, no matter how large the temperature difference of the baths is. 

Once the uniqueness of the steady state is established, we show that, away from equilibrium, 
there is a stationary, strictly positive heat flow through the chain and the (thermodynamic) entropy 
production is strictly negative. We also discuss briefly (heuristically) a suitable version of the 
Gallavotti-Cohen fluctuation relation [ECM, GC1, GC2, G, K, LS] for the entropy production 
in the context of our model. 

2. Set-up and Notations 

To make this paper accessible without the necessity of referring back to [EPR], we introduce 
again the model. It deals with an anharmonic chain driven at its ends by two heat baths. 

The chain consists of n particles moving in R d , with n arbitrary but finite, and its dynamics 
is described by the following Hamiltonian: 

n p 2 

H s {q 1 ,...,q n ,p 1 ,...,p n ) = +V{q 1 ,...,q n ) , 

j = l 

where the potential V is of the form: 1 

n n— 1 

We make the following assumptions on the potential V: 
HI) Behavior at infinity: We assume that V is of the form 

V(q) = ±(q-a t Q(Q-a))+F(q), 

where Q is a positive definite (dn x dn) matrix, a is a vector, and d („)F E T for 

i = 1, . . . , n and v = 1, . . . , d. Here, JF denotes the space of those C°° functions F on 
R dn for which d a F(q) is bounded uniformly in q G R dn , for all multi-indices a. 



The two-body potential is slightly more restrictive than in [EPR], since we only take functions of the coordinate 
differences. 



Entropy Production 



3 



H2) Coupling: Each of the (d x d) matrices 

■Mi(x) = T> 2 u[ 2 \x) , z=l,...,n-l, 

of second derivatives, is either uniformly positive or negative definite for x G R d . 
Each heat bath is modeled by an infinite dimensional linear Hamiltonian system, which is 
a scalar field whose dynamics is governed by a (/-dimensional wave equation: 

#b(0^) = \f dx(|V0j 2 + |ttJ 2 ) . (2.1) 

We will denote the heat baths by the subscripts L and R respectively. We couple the L heat 
bath to the first particle of the chain and the R heat bath to the n-th particle of the chain. We 
choose a coupling which is linear both in the field variables and in the particle variables. The 
total Hamiltonian of the system is then given by 



H(q,p,(f) L ,7r L ,(f) R ,7r R ) = i? B (^,7rJ + H s (q,p) 

iE{h,R} 

+ q x ■ J dxV(j) L (x)p L (x) + q n - J dxV (f) R (x) p R (x) 



We consider the heat baths at positive temperatures T L and T R respectively, i.e., we will assume 
that the initial conditions of the heat baths are distributed according to the Gaussian measure with 
mean zero and covariance (-,-) i T i , where (•, ■) i is the scalar product defined by the quadratic 
form (2.1), i e {L, R}. 

The following reduction to (essentially only) the variables of the small system is explained 
in detail in [EPR]: We integrate out the variables of the baths and project the dynamics on the 
variables of the chain. This leads to integro-differential stochastic equations. Under suitable 
assumptions on the coupling functions p L , p R , they can be expressed as Markovian equations 
upon introducing auxiliary variables r i m with i E {L, R}, and m = 1, . . . , M. At the end, one 
obtains (see [EPR] for details) the following system of stochastic differential equations: 



dqj(t) = Pj(t)dt, j = l,...,n, 

M 

d Pl (t) = -V q V(q(t))dt+J2r L , m (t)dt, 

m=l 

dp.(t) = -V q V(q(t))dt, j = 2,...,n-l, 

M 

4P»(*) = -V q V(q(t))dt+ V r R (t)dt , ( 2 - 3 ) 



m=l 



dr R im ( f ) = -7 R , m r R , m (^ + \\ >m l Rim q n {t)dt - A Rim y / 2 7R m T R d«; Rim (t) 
m= 1,...,M, 
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which defines a Markov diffusion process on j^ 2d ( n + M ) Each w L m and w R m is a standard 
d-dimensional Brownian motion. 

Remark 2.1. In Eqs.(2.3) the variables r L m , r R m describe both the (random) forces exerted 
by the heat bath on the chain and the (dissipative) forces due to the retroaction of the heat baths on 
the chain. The fact that the variables r hm ,r Rrn obey Markovian stochastic differential equations 
is a consequence of our choice of coupling functions p h , p R . In fact, these functions are chosen 
in such a way that the random forces exerted by the heat baths are not white noises but have 
covariances which are (sums of) exponentials. Together with the fluctuation theorem relating 
these random forces with the dissipative forces, one obtains Markovian differential equations on 
the phase space consisting of the physical variables p, q, augmented by the auxiliary variables 

r L,m> r R,m- 

Remark 2.2. If the temperatures of the two heat baths are the same, i.e., if T L = T R , the 
stationary state of the Markov process which solves (2.3) can be written explicitly. It is given 
by the generalized Gibbs state 

p(dr,dq,dp) = p T ^ Th (dr,dq,dp) = Z~ l e~ G ^ {r ^ v)IT ^dr dqdp , (2.4) 

where the "energy" is given by 

Ml 2 

G<°>(r, q,p) =H s (q,p) + J2(^ + ~ Qi ' r L>m ~ q n • r R>m ) . (2.5) 

m=\ L,m R,m 

The marginal of this measure on the physical phase space is given by 

v(dq, dp) = J p(dr,dq,dp) = -^e~ Hci ^ Tl -dqdp , 
where the effective Hamiltonian H sS is given by 

M M 

H eS (q, P ) = H s (q,p) - \q\ £ A£ >m - \q\ ^ A R>7n = \p 2 + V efl (q) . (2.6) 

m=l m=l 

It can be seen from (2.6) that the coupling between the chain and the heat baths induces a 
renormalization of the potential V(q). In particular, because of Condition HI, if the coupling 
constants X im are too large, V^ ff (g) is not confining any more, and the measure p is not a 
probability measure, but only cr-finite. In the sequel we require the following: 
H3) The coupling constants X im , i e {L, R}, m e {1, ... , M} are such that 

lim V eS (q) = oo . 
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3. Uniqueness of the Stationary State 

In [EPR] we proved, under the conditions H1-H3, the existence of an invariant measure 
for any temperature T L , T R , but the uniqueness was shown only for small temperature differences. 
In this section, we extend the uniqueness result to arbitrary temperature differences. 

The uniqueness will follow from a dynamical argument: we will show that the Markov pro- 
cess is transitive. This is done using a (well-known) relationship between stochastic differential 
equations and control theory (see e.g., [Ku] and references therein). 

We explain the method for a general stochastic differential equation of the form 

dx(t) = b(x(t))dt + adw(t) , (3.1) 

where x G R fc , b(x) is a C°° vector field, w(t) is a standard ^-dimensional Brownian motion, and 
a is a k x £ matrix. We assume that the vector field b(x) is such that (3.1) has a unique solution 
forallt > 0. One then replaces dw (t) in (3.1) by u(t)dt. The function u(t) = (u l (t), . . . , u e (t)) 
is called a control. One obtains the system of ordinary differential equations 

x = b(x(t)) + au(t) . (3.2) 

The correspondence between the two systems is established by the following result of 
Stroock and Varadhan [SV]. We fix an arbitrary time r > 0. Let U denote the set of piecewise 
constant functions u : [0, r] — > R £ . Let W be the set of all continuous functions ip from [0, r] 
to R fc equipped with the uniform topology and let W x = G W : </?(0) = x}. We denote 
£ x the diffusion process defined by (3.1) with initial condition £ x (0) = x. Then the path £ x 
belongs almost surely to W x . The support of this diffusion process £ x on [0, r] is, by definition, 
the smallest closed subset S x of W x such that 

PKx e 5J = l , (3.3) 

where P is the probability induced by the Brownian motion w. We denote by ip™ : [0, r] — > R fc 
the solution of the differential equations (3.2) with control u and initial condition x. We next 
consider the notion of accessibility. Let x and y be two points in R fc . The point y is called 
accessible from x at time r (r > 0) if there is a control u such that <p x (t) = y. The set of all 
points which are accessible from x at time r is denoted Y T (x). 

Theorem 3.1. [SV]. One has 

S x = {<p% :ueU}, (3.4) 

for all x e R fc , and 

supp P(t,x, •) = Y T (x) , 

for all x G R fc and r > 0, where P(t, x, dy) denotes the transition probability of the process 

Remark. The first statement is explicit in [S V] and the second is a straightforward consequence 
of the first. 
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The main technical result of this section is the following 

Theorem 3.2. The control system associated with the stochastic differential equation (2.3) 
is strongly completely controllable, i.e., Y T {x) = R 2d ( n + M ) j f or a \\ x = r L , r R ) and all 

T > 0. 

Remark 3.3. We will combine this result with Theorem 3.1 and hypoellipticity to show that 
the invariant measure has a smooth, strictly positive density. 

Remark 3.4. It should be noted that strong complete controllability (SCC) can not be deduced 
from Hormander's hypoellipticity condition alone. (See e.g., [IK] for examples of hypoelliptic 
diffusions with two invariant measures). Therefore, Theorem 3.2 contains additional informa- 
tion. Various sufficient conditions for SCC have been expressed in terms of differential geometry 
in [Ku], but these are not applicable to Eqs.(2.3). 

Proof of Theorem 3.2. We will show the strong complete controllability of the control 
problem associated with (2.3) by an explicit approach using the requirement of effective coupling 
(condition H2) of the chain. 

We reconsider the stochastic differential equation (2.3). Following the procedure described 
above we replace the Brownian motions w im (t) by controls u im (t) in (2.3), and rewrite the 
system thus obtained as a system of second (and first) order equations. This leads to: 

TL,m r L,m + ^L,m7L, m ?l + «L,m , TO = 1 , . . . , M , (3.5) 

M 

V 9l ^) + E r L,-' (3-6) 

W q V(q), j = 2,...,n-l, (3.7) 

M 

v ^) + E r R,-' ( 3 - 8 ) 

m=l 

7R,m r R,m + A R,m7 R , m 9n + u R,m > TTl = 1, . . . , M . (3.9) 

Here, we have absorbed the constants in front of the Brownian motion in (2.3) into the controls 
u im (t). We will only consider controls u of class C°°. Any such function can be uniformly 
approximated, on any compact interval, by a piecewise constant function. Since a simple 
Gronwall estimate of Eq.(3.2) shows that 

sup \<pl{t) - <p v x {t)\ < C(r) sup \u(t)-v(t)\ 

t€[0,r] t€[0,r] 

holds with a constant C(r) depending on the model, but not on u and v, we conclude that 

KW:^e°°(R)} cYJxj. 
The proof of Theorem 3.2 will now be done in two parts: 



L,m 



Qi = 



Qn = 



R,m 
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Part 1: Boundary control of the chain. We start by considering the auxiliary problem 
of controlling a chain of n + 2 oscillators by the motion of the two ends of the chain. 
The differential equation reads 

5j = fj(Qj-i>Qj>Qj+i) » j = h---,n, (3.10) 

where q = . . . , q n ) is the dynamical variable, whereas q = w L and g n+1 = -u^ are the 
control variables. The smooth functions f- are given by 

/,-(*, y,z) = -(wj 1} )(y) - (Vt/f % - z) + (Vt/f_\)(x - y) . 

Here, we define U^\x) = U^(x) = x 2 /2. 

(2) 

Note that by Condition H2, the functions VC/- are diffeomorphisms. It follows that 
the equation w = fj(x, y, z) can be solved for z : There exist smooth functions g- such that 

w = /• (x, y, gj(x, y, w)) for all x,y,w G R d . Consequently the differential equation (3.10) is 
equivalent to the equation 

Qj+i = 9j(Qj-vQj, Qj) , j = l,...,n. (3.11) 

Obviously, for given q and q 1 , this equation can be solved inductively, and in a unique way. To 
express this solution, let us introduce some notation. For a smooth function cp and an integer 
a, we shall denote the collection of the first a derivatives of <p by (p [a ^ = (<p>, cp, . . . , ^ a '). We 
also si 
reads 

G (d [0] ) , 
Gi(v m ) > 

G 2 (n m ) , 

G 5 (ew 4] ), 

r (Aln-2] [2n]\ 

We can organize the 2n + 2 maps G j into a map G: R 4nd -> R 4nd in the following way: Denote 
by (a, b) a point of R 4nd , with a = (a , . . . , a 2n _ 2 ) G R,( 2n_1 ) d and b = (b , . . . , 6 2n ) G 
R (2n+i)d_ with a [«] _ ^ _ _ _ ^ a j and 6 [«] = ^ ...,b a ), define G(a, 6) = (a, G(a, 6)) 
where 

G(a,6) = (G 1 (6f ^G 2 (6 ri ^G 3 (af°\6 [2 ^...,G 2n+1 (a^- 21 ,6^)) . 

We have proved that, if (u L , q v ...,q n , u R ) is a solution of Eq.(3.10) on the time interval 
I C R, then 

(u?"" 21 ^!, ft,..., = G(u^- 2 \q^) (3.12) 



9j for J = 1, • 


. . . , n. For q = 


i and q x 


U L = 






Qi = 


V 




Pi = 


Qi 




Q2 = 






P2 = 


Q2 




% = 






U R = 


9n(ln-l^ IniPn 


) = 
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holds on /. A simple consequence of this fact is that G is a bijection. Indeed, repeated 
differentiation of Eq.(3.10) gives 

Q? } = d t q[ 2) = F 3 (u l l\q 1 ,q 1 ,q 2 ,q 2 ) , 

— f) J 20 *- 1 ) _ F !%,r 2Q - 2 l n n \ 

(2a + l) _ o (2a) _ ^ / [2a-l] • • \ 

Ql - °Wl - b 2rX U L ,Qi,Qi,---,u R ), 

and thus we find another functional relation gp n] = F(tt^ n_2 - 1 , q v q v . . . , q n , q n , u R ) for its 
solutions. It immediately follows that the map F: (a, b) i— > (a, F(a, 6)) satisfies 

foG^f) = («g n - 2] ,?S 2n] ) , 
GoF(u l l n ~ 2 \q l ,q 1 ,...,u R ) = (wg n_2] , g 1} q u . . . , u fl ) , 

on every solution of Eq.(3.10). Since u£ n_21 (0) and either g[ 2nl (0) or (g(0),g(0), u L (0)) can 
be prescribed arbitrarily, we conclude that F = G~ l . 

To solve our control problem it suffices to remark that the set of solutions (u L , q, u R ) 
satisfying (w^ n_21 (t ), g 1 (t ) , qi(t ), . . . , u R (t )) = (a, b) is identical with the set of solutions 
satisfying (u£ n_2] (t ), q l2n] (t )) = F(a,b). Since for r > and arbitrary (a, 6), (a', b') E 
R 4nd one can find functions u L and q 1 for which 

(^- 21 (0),^(0)) = F(a,b), 
(u l l n - 2 \r),q? n \r)) = F(a',b'), 
we see that the system (3.10) is strongly controllable. 

Part 2: Completion of the proof of Theorem 3.2. We reduce the problem of 
Eqs.(3.5)-(3.9) to the case dealt with in Part 1, by introducing the auxiliary variables g and 

q n +i- Recalling the definition Uq(x) = U^\x) = x 2 /2, we can rewrite the control problem 
associated with our stochastic differential equation as 



Qj = fj(Qj-i,Qj,Qj+i) > j = l,...,n 

r L,m = Ql-%, 



*3 

M 



m=l 
M 



r R,m ~ Qn+1 



(3.13) 



In > 



U L,m = r L , m + 7L,m r L, m ~ A L, m 7L, m ?l , m=l,...,M 



2 

U R,m = ^R,m + lR,m r R,m ~ ^Rml^mMn > m = I, . . . , M 
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with the boundary conditions 



(r L (0), qi (0), qi (0),...,q n (0),q n (0),r R (0)) = x, 
{r L {T), qi (T),qi{T),...,q n {T),q n {T),r R (T)) = y. 



The equation X)™=i r Lm = 1\~~% serves to compensate the term q 1 — q produced when 
differentiating f 1 in (3.13). Given the boundary data for r L , q Y , q n and r R we obtain boundary 
values for q and q n+l . We can thus control the first equation by our previous result. This gives 
us g , . . . , q n+ i- Selecting arbitrary functions r L 2 , . . . , r L M and r R 2 , . . . , r R M satisfying the 
corresponding boundary data, we define 



These two functions will also satisfy the boundary conditions. Finally we use the last two sets 
of equations to determine the control variables u L m and u R m . This concludes the proof of 
Theorem 3.2. 

Remark 3.5. It is obvious from the proof of Theorem 3.2 that this theorem is valid under 
much weaker conditions than those given in HI. It is enough to require that the stochastic 
differential equation (2.3) has a unique solution for all t > 0. In particular we do not need to 
restrict ourselves to potentials which are "quadratic at infinity" as required in the proof of the 
existence of the invariant measure. 

The main result of this section is: 

Theorem 3.6. If Conditions H1-H3 are satisfied, the Markov process which solves (2.3) has 
a unique invariant measure p, = p, T . The measure p has a C°° density p(r, q, p). This density 
is an exponentially decaying, strictly positive function of r, q, and p. The invariant measure is 
ergodic and mixing. 

Remark 3.7. In fact, combining this result with information from [EPR], one can show that 



where G (0) was defined in (2.5), and T* = max(T L ,T R ). The function / is in the Schwartz 
space S when T L ^ T R , (and is a constant otherwise). 

Proof. The proof is a combination of Theorem 3.1 and Theorem 3.2 with results in [EPR]. 
The existence of the invariant measure fi is proven in [EPR, Theorem 2.1]. Furthermore, using 
hypoellipticity, we showed that the density p of \x is C°°. Also, the transition probabilities 
P(t, x, dy) have a smooth density, p, defined by P(t, x, dy) = p(t, x, y)dy with p(t, x, y) E 



M 




M 




p{r,q,p) = f(r,q,p)exp(-G(°Hr,q,p)/T*) , 



e°° ( (0, oo) , K 2d(n+M) , R M (-+ M ) ) . 
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We next show that the support of p is all of the extended phase space X = R 1 ' . In 
Theorem 3.2, we have seen that (2.3) is strongly completely controllable. By Theorem 3.1, we 
conclude that the support of P(r, x, •) is the whole phase space for every x E X and all r > 0. 
Therefore, we have, for all t > 0, all x, and all open sets Y, the inequality 

P(t,x,Y) > 0. 

Since p(Y) = J p(dx)P(t, x, Y) (because p is invariant), we conclude that supp p = X and 
thus the density p is Lebesgue almost everywhere positive. 

We next show that p{x) > 0, for all x. by assuming the contrary and deriving a contradic- 
tion. Assume that there is a y for which p{y) = 0. By the invariance of the measure we have, 
for any t > 0, 

= p(y) = J dxp(x)p(t,x,y) . 

This implies p(t, x, y) = for Lebesgue almost all x. Since the transition kernel p is smooth, 
we conclude that the function p(t, - ,y) is identically zero every t > 0. On the other hand, since 
p is the kernel of a strongly continuous semigroup, we also have p(t, x,y) — > 5(x — y) as t — > 0. 
This is a contradiction, and we have shown p(y) > 0, for all y E X. 

We next show uniqueness. We have just shown that every invariant measure must have 
a smooth, strictly positive density. Since every ergodic component is mutually singular to any 
other, the invariant measure is unique (and ergodic). The property of mixing of the invariant 
measure has been deduced from uniqueness in the proof of [EPR, Theorem 3.9] . This concludes 
the proof of Theorem 3.6. 

Remark 3.8. We proved in [EPR, Lemma 3.7] that the density p = p T is a real analytic 
function of £ = (T L — T R ) / (T L + T R ) . In particular, this yields the standard perturbative results 
near equilibrium (£ = 0). 

4. Time-Reversal, Energy Flux, and Entropy Production 

In this section, we ask questions which are intimately related to the Hamiltonian nature of our 
model. After introducing appropriate notation, we introduce time reversal, and draw some 
consequences. In particular, we are able to show that the system exhibits non-zero mean energy 
flux as soon as T h ^ T R , and we relate the flux to the entropy production. 
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4.1. Notation 



It will be useful to streamline the notation. It is convenient to introduce first p L m = 
(\ m 7Lm)~ lr L m an d similarly for the r R m . Then the equations of motion are 



dq^t) = Pj(t)dt, j = l,...,n, 

M 

4Pi(*) = -V gi ^(?(t))dt+^A L)m7 ^p L)m (t)dt 

m=l 

dp/*) = -V,.y(?(*))dt, j = 2,...,n-l, 

M 

1/2 



4P„(*) = -V g ^(?(t))dt+^A Rjm7 ^p Rjm (t)dt, 

m=l 

dp L ,™(*) = -7L,m^ >m (*)d* + A L>m Ti^ 9l (t)<tt- V2Tl /2 dw Um (t) , 
d PR,m(t) = -lR, m pR, m (t)dt + X Rjm ll%qJt)dt-V2Tl /2 dw R m (t) , 



(4.1) 



m= 1,...,M. 

We can write this system in vector notation: We write the Hamiltonian of the chain (the 
small system) as 

H s (q,p) = ^+V(q), 



with g,p£ R nd . The two reservoirs, L and R, are described by the variables p = (p L , p R ) e 
R Md © R Md . The "energy" of the complete system, i.e., chain and reservoirs, is then given by 

G^(r,q,p) = G^(p,q,p), where now 

G^(p,q,p) = H s (q,p) + ^p-Tp-q-AT 1 / 2 p. 

Here, T = T L © T R , where T i is the diagonal (M x M) matrix diag( 7i l7 . . . , 7i M ), with 
i G {L, R}. Note that by assumption, the 7 's are all strictly positive. We also define A as the 
(2Md x nd) matrix given by 

M M 

q- Ap = q l ■ A L p L + q n ■ A R p R = q x ^ A L m p L m + q 

m=l m=l 

With these notations, the equations of motion can be written as: 

dq = V p G {l) dt = pdt , 

dp = -V q G {l) dt = -(V q V(q) - AT l/2 p)dt , 

dp = -V p G {l) dt-{2T l/2 )dw = -(Tp -T 1/2 A T q)dt - (2T 1/2 )dw . 
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Here, w = w L © w R = (w L l , . . . , w L M , w R x , . . . , w R M ) is a 2M<i-dimensional standard 
Brownian motion, and T is the (2M x 2M) diagonal temperature matrix 

t = diag(r L ,...,r L ,r R ,...,r R ). 

It is useful to introduce the (final!) change of variables s = p — F T q, where F = Ar -1 ^ 2 . In 
terms of these variables, one can introduce the effective potential 

KM = V(q) - \q ■ AA T q , (4.2) 

and the "energy" is now q, p) = (p, q, p) with 

G(s,q,p) = \p 2 + V en + \s-Ts. (4.3) 

Finally, with the adjoint change in the derivatives V q — > V q — FV s , the equations of motion 
become 

dq = V p Gdt = pdt , 

dp = -(V q - FV s )Gdt = - {V q V t{i (q) ~ FTs)dt , (4.4) 
ds = -(V s + F T V p )Gdt-(2T l/2 )dw = -(Ts + F T p)dt - (2T l/2 )dw . 

Notation. In the sequel, we shall write G p for V ' G and G q for V ' G (these are vectors with 
nd components), and G s for V S G (this is a vector with 2Md components). 

The generator L of the diffusion process takes, in the variables s, q, p, the form 

L = V s -TV s -G s -V s + {G p -V q -G q -V p ) + {(FG s )-V p -G p -FV s ) . (4.5) 

If / is a function on the phase space X, we let 

S'fix) = (e Lt f)(x) = J f(Ut))dP(w). 

The associated Fokker-Planck operator L T is the adjoint of L in the space L 2 (R_ d ( 2M + 2n ) , dx), 
i.e., 

L T = V s • TV S + V s • G s - {G p -V q -G q - Vj - {(FG 8 ) -V p -G p - FV s ) . (4.6) 



Remark 4.1. The density p of the invariant measure is the (unique) normalized solution of 
the equations 

L T p = . 
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4.2. The Entropy Production a 

We now establish the relation between the energy flux and the entropy production. Since we are 
dealing with a Hamiltonian setup, the energy flux is naturally defined by the time derivative of 
the mean evolution S* of the effective energy, H eS (q,p) = p 2 /2 + V ef£ (q). Differentiating, we 
get from the equations of motion 

LH eS = p ■ (-V q V sS + FTs) + V q V eS ■p=p-FTs. 

We define the total flux by $ = p ■ FTs, and inspection of the definition of F and T leads to the 
identification of the flux at the left and right ends of the chain: 

$ = $ L + $ R , 

with 

$ L = Pl ■ A L r[ /2 « L , 

$R = Pn ■ A R F R 2 % • 

1 /2 

Note that A L r L 7 s L is the net force exerted by the left bath on the chain. Therefore, <£> L = 
Pj • A L r^ 2 p L — Lq x - h^q { /2 is, up to a time-derivative which vanishes in the stationary state, 
the total power dissipated by the left bath. A similar interpretation holds for $ R . Furthermore, 
observe that 

<*>„ = 0, (4.7) 

where, generally, 

(/>„ = J ^x)f(x) . 

The Equation (4.7) holds because $ = LH eS and l7 \i = 0. 

We next proceed to define the entropy production in the setting of our model. Since we have 
been able to identify the energy flux on the ends of the chain, we define the (thermodynamic) 
entropy production a by 

a = + =p-FT- l Ts. (4.8) 

1 L i R 

We refer to [CL] and references therein for a detailed discussion of the various types of entropy 
production in non-equilibrium stationary states. In Subsection 4.4, we will explain, in the 
context of our model, the relationship between the entropy production a and the Gibbs entropy. 



Entropy Production 



14 



4.3. Time-Reversal, Generalized Detailed Balance Condition, and Negativity 
of the Entropy Production 

Definition. We define the "time-reversal" map J by (j/)(s, q,p) = f(s, q, —p). This map 
is the projection onto the space of the s, q, p of the time-reversal of the Hamiltonian flow (on the 
full phase space of chain plus baths) defined by the original problem (2.2). 

Notation. To obtain simple formulas for the entropy production a we write the strictly positive 
density p of the invariant measure p as 

p = J e - R e- Lp , (4.9) 

where we have introduced the quantity 

R = R( s ) = ± s -TT- l s . (4.10) 

Let L* denote the adjoint of L in the space "K^ = L 2 (X, dp) associated with the invariant 
measure p with density p. In terms of the adjoint L T on L 2 (X, ds dqdp), we have 

L* = p~ l L J p. (4.11) 

Let L x = L + Act, where A G R. (This definition is suggested by the paper [K], see below.) 
We have the following important symmetry property: 

Theorem 4.2. One has the operator identity 

Je- J(p (L x )*e J(p J = L x _ x . (4.12) 

In particular, one has 

Je~ jLp L*e jLp J - L = a. (4.13) 

Remark 4.3. This relation may be viewed as a generalization to non-equilibrium of the 
detailed balance condition (at equilibrium, one has JL*J — L = 0). 

Remark 4.4. Recently, a lot of interest has been generated in the wake of papers by Gallavotti 
and Cohen, [GC1, GC2, G, and references therein], in which intriguing relations for the fluc- 
tuations of the entropy production have been found. These papers dealt first with numerical 
experiments by [ECM], which were then abstracted to the general context of dynamical systems. 
In further work, these ideas have been successfully applied to thermostatted systems modeling 
non-equilibrium problems. In the papers [K] and [LS] these ideas have been further extended 
to non-equilibrium models described by stochastic dynamics. In the context of our model, the 
setup is as follows: One considers the observable 



W(t) = fdraiUr)) 
Jo 
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By ergodicity, lim t ^ oc t~ l W(t) = (cr) for ^-almost all x. We are interested in the rate 
function e for the large deviations of W(t)/(t(a) fJ ), and want to argue (heuristically) that it 
satisfies 

e(w) - e(-w) = -w(a)^. (4.14) 

In particular this means that at equal temperatures, when (a)^ = 0, the fluctuations are symmet- 
ric around the mean 0, while at unequal temperatures, the odd part is linear in w and proportional 
to the mean entropy production. This is the celebrated Gallavotti-Cohen fluctuation theorem. 
The rate function e is characterized by the relation 

inf e(w) = - lim -logP | G / 

wei v ' t^oo t 6 yt(a)^ 

Under suitable conditions it can be expressed as the Legendre transform of the function 

e(A) = - lim t- 1 log(e- w(t) ) . 

Formally, — e(A) can be represented as the maximal eigenvalue of L x . Observing now the 
relation (4.12), one sees immediately that 

e(A) = e(l - A) . (4.15) 

This in turn implies (4.14). A rigorous derivation of the program outlined above lacks several 
technical ingredients, in particular, more spectral information about L x seems to be necessary. 

The relation (4.12) has a number of other consequences which we enumerate now, before 
going to the proof of Theorem 4.2. It allows to prove that the entropy production is negative in 
our model and it yields an interesting symmetry relation (see Theorem 4.6). 

Proposition 4.5. One has the following identities (between functions): 

Lv? = <r + |T 1/2 V S v?| 2 , (4.16) 
L*Jip = -a- \T l/2 V s Jtp\ 2 . (4.17) 

Here, |/| 2 = / • /. 

Theorem 4.6. In the stationary state n the entropy production satisfies the identity: 

= ~(\T l/2 VM 2 ), = -<|T 1/2 V s Jvf > M < . (4.18) 

Remark 4.7. In Subsection 4.5, we will show that the heat flux is non-zero for unequal 
temperatures by showing that the entropy production in the stationary state satisfies: 



Entropy Production 16 

if and only if T L = T R . 

The remainder of this subsection is devoted to the proofs of Theorem 4.2, Proposition 4.5, 
and Theorem 4.6. 

Proof of Theorem 4.2. We show the identity 

e R JL T Je~ R = L + a. (4.19) 

Starting with the relation 

e R V s e~ R = V s - (V S R) = V s -T~ l G s , 

we get, using the definition of L , 

e R JL T Je- R = V s • TV S - G s • V s 

+ (G p -V q -G q - Vj + (Fr« • V p - p ■ FV S ) 
+ G p -FT~ l G s . 

Note that the sum of all the terms except the last equals L, while the last equals 

G p ■ FT~ l G s =p-FT- l Ys = + gn^fg = a . 

We have thus shown (4.19). Combining (4.19) with the expressions (4.1 1) and (4.9) for L* and 
p we obtain the identity: 

L + a = e R JL J Je- R = e R Je- R e~ J * L*e J *e R Je~ R = Je~ Jip L*e Jip J , (4.20) 

which is (4.12) for A = 0, i.e., Eq.(4.13). Observing now that JaJ = —a, we obtain 

Je- J ^L* x e J ^J = L,_ x , 

and thus conclude the proof of Theorem 4.2. 

Proof of Proposition 4.5. From (4.12) we obtain the identity 

JL*J = e <f {L + a)e- if . (4.21) 

A straightforward computation shows that, for any smooth function /, we have the following 
operator identity 

e f Le -f = L — 2(VJ) ■ TV S - (Lf) + \T l /\ VJ) | 2 • (4.22) 
Applying (4.22) with / = ip we obtain from Eq.(4.21) the operator identity 

JL*J = L - 2(V s <p) ■ TV S - (Lip) + \T l '\V a <p)\ 2 + a . (4.23) 
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Since L* = p l L T p and L 1 p = we have L* 1 =0. Applying the operator identity (4.23) to 
the function 1 and noting that Jl = 1 we get 

= JL*Jl = -Lv? + \T^ 2 {V 8 <p)\ 2 + a , (4.24) 

and this is the identity (4.16). With this, (4.23) simplifies to 

JL*J = L-2(V sV ?) -TV S . (4.25) 

Applying the operator identity (4.25) to the function ip, and using (4.24) we get 

JL*Jip = Lip-2\T l/2 (V s <p)\ 2 
= a-\T l ' 2 (VM\ 

or, equivalently, 

tfjtp = - a -\T l / 2 (V s J V )\ 2 , 

which proves (4. 17). With this we have concluded the proof of Proposition 4.5. 

Proof of Theorem 4.6. Theorem 4.6 is a simple consequence of Proposition 4.5. From 
(4.16), using the invariance of the measure p, we get 

= (L<P)»-(\T l/2 (V 8 <p)\ 2 ), 
= -(IT^V^IV 

which yields the first equality in (4.18). The second inequality is obtained in the same way 
using (4.17). We have 



= -(L*j<p) lt -(\T l ' 2 (y a j< P )\ 2 ) lt 

= -(\T l ' 2 {V a J<p)\\, 
where the last equality in (4.26) follows from the identity 



(4.26) 



It is obvious from (4.26) that the entropy production in the stationary state is a non-positive 
quantity and this concludes the proof of Theorem 4.6. 

Other observables for the entropy production. The analysis done for the entropy 
production a can be repeated for other observables, (see also [LS] for a similar generalization). 
A family of such observables can be obtained by replacing the conjugation operator e Jip J of 
(4.12) by any conjugation operator of the form e^e Jip J, where / = f(q,p) satisfies Jf = f } 



1 The operators e v J are all formally selfadjoint on . 
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Interesting examples are obtained when one considers the energy flux between position j and 
the j + 1 on the chain, j = 1 , . . . , n — 1 . To this end we write the Hamiltonian i7 eff as follows: 

n 

H efi {q,p) = J2 H i(^P) > 
i=i 

where 

2 M 

HM.P) = | + - \ti E A l,™ + ^i (2) (?i " > 

m=l 

= | + U^\q i ) + lu^\(q i _ l -q i )+ 1 -UP( qi -q i+l ), i = 2, . . . , n - 1 , 

2 1 M 

= ^ + ^(O " 2 E X lm + ^l^n-l " O ' 

m=l 

For any j = 1, . . . , n — 1, we choose / = — Sj, where 

L i=l R i=j+l 

We write now the invariant density p as 

p = Je- R e - s ie-^i , 

z'.e., ipj = if — Sj . Variants of computations done above show that we have the operator identity, 
similar to (4.20): 

e s ie R JL T Je~ R e~ s i = L + a j , 
where a - is given by the relation 

n J n LS J , (4.27) 
since Sa does not depend on the variable s. Our choice of S 1 ■ has been made in such a way that 

^ = (t~t) ^-^+i)- w(2) ^-^)' 

i.e., is the energy flux between position j and j '• + 1 on the chain multiplied by the difference 
between the inverse temperatures of the heat baths. Using next that JS- = Sj one derives easily 
a relation corresponding to (4.12), namely, 

Je~ J ^(L + Xa^e^J = L + (1 - A)^- . (4.28) 

We have thus found n — 1 "entropy productions" cr j 5 which, under the assumptions made 
for a, satisfy a fluctuation theorem. Note that these entropy productions are all different 
observables, but, because of Eq.(4.27), the expectations of a and o- in the stationary state p 
coincide. 
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4.4. Relation with the Gibbs Entropy 

We give now a second proof of the negativity of entropy production in our model using the 
Gibbs entropy. 

Let v be a probability measure in the variables x = (s,q,p) and let v t denote the time 
evolution of u given by 

v t (dx) = J v (dx')P(t, x', x) . 

Because of the properties of the transition probabilities P(t, x', x) proven in Sect. 3, we see 
that v t is a probability measure (for any t > 0) with a smooth positive density denoted f t in the 
sequel. The time evolution of / is then given by the equation 

dJt = L T f t . 

We define the Gibbs entropy as 

S(f) = - J dxf(x)logf(x), 
and we compute next the entropy change in time. We get: 

Wt) = "/ d*(0 t / t )(l + log/ t ) 

= -(L T /,,(l + log/ t )) 
= -(/ t ,Llog/ t ) 

= -u,/r^/t) + (/t,l^ 1/2 v s iog/ t i 2 ) = X l . 

The last term is the (additional) contribution from the second order derivative (in s) appearing 
in L when it acts on log /. We can transform X l further by writing it as 

X x = -(L T lJ t )+ (f v \T" 2 V s \ogf t \ 2 ) . (4.29) 

Since L T 1 = Tr Y the first term in (4.29) is equal to -Tr Y. We use the definition (4.10) of R 
and the analog of (4.9) to define (p t : 

Je- R e-v* = f t . (4.30) 

Since JRJ = R, we see that — log f t = R + J(p t . Expanding the second term in (4.29) we 
obtain 

(f t ,\T 1/2 V s \ogf t \ 2 ) = (U\T- l / 2 Ys\ 2 ) + (f v \T +1 / 2 V s M\ 2 ) +2(f t ,Ts. V a J<p t ) . 

(4.31) 

Since we have the relation 

v./ t = -f t {W s R + W s M), 
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we obtain 

f t V s M = -f t V s R-VJ t . 
Using this and integrating by parts, we rewrite the third term in (4.31) as 

2(f t ,Ts-V s J<p t ) = -2 J dxTs-(f t V s R + VJ t ) = -2(/ t , \T- l ' 2 Ts\ 2 ) + 2Tr T . 

Altogether we obtain 

d t S(f t ) = Tr T - (/,, \T- [ / 2 Ts\ 2 ) + (f t , \T l ' 2 V s J^ t \ 2 ) . 
Using the identity 

LR = Tr T — \T~ l/2 Ts\ 2 - a , 

we obtain finally, 

d t S(f t ) = J dxf t a + J dxf t LR + J dxf t \T l ' 2 V s J^ t \ 2 . (4.32) 
In line with the ideas of [CL], we can write this last identity in the form: 

W,) - << = (\T l/2 V s M\ 2 ) Ut +d t (R)„ t • 

This shows that the (rearrangement) entropy produced in addition to the thermodynamic entropy 
a is a positive quantity, up to a (time-) boundary term. Also note that if v t = ji, i.e., if the 
system is in the stationary state, then we get the identity 

0= <^ + <|T 1/2 JV s ^lV (4.33) 
which we already found in Theorem 4.6. 



4.5. Strict Positivity of the Heat Flux 

We first show that the thermodynamic entropy production, as defined in (4.8), is negative 
in our model. As an immediate consequence we will show that, in the stationary state, energy 
is flowing from the hotter heat bath to the colder one. 

Theorem 4.8. The entropy production a satisfies: 
if and only if T L = T R . 

Proof. NotethatifT L = T R ,thena = d t S l H^/T^^ and therefore (a) ^ = 0. Wewillshow 
that if T L 7^ T R , then (a) ^ 0. We will proceed by assuming the converse, namely (a) = 0, 
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and produce a contradiction. The assumption implies, by (4.18) that (|T ,1//2 V S <^| 2 ) M = 0. Since 
p is positive, this means that V s p = 0, and therefore ip does not depend on the s variables. 
From (4.16) we obtain 

= -L<p + |T 1/2 V s v?| 2 + a = -Lip + a . 
Using the definition of L and a and the fact that <p does not depend on s, we obtain the equation 

= (p • V q p> - (V g Kff) ' V p ^) + FYs ■ (V p p - T~ l p) . 
Since ip does not depend on s we get 

p ■ v 9 v? - (v.Kff) • v p ^ = o , 

V Pl ^ = T~ l Pl , (4.34) 

We will show that this system of linear equations has no solution unless T L = T R . To see this 
we consider the system of equations 

p ■ v q v - (v.Kff) • = o 

This system has a solution which is given by H eS (q,p)/T L . We claim that this the unique 
solution (up to an additive constant) of (4.35). 

If this holds true, then the only solution of (4.34) is given by H eff (q : p)/T h and this is 
incompatible with the third equation in (4.34) when T L ^ T R . 

Since (4.35) is a linear inhomogeneous equation, it is enough to show that the only solutions 
of the homogeneous equation 

p ■ v q v - (v g K ff ) • v p ^ = o , 

are the constant functions. Since V p <p = 0, p does not depend on p v we conclude that the 
first equation in (4.36) reads 

Pi -V qi <p + f 1 (q 1 ,...,q n ,p 2 ,---P n ) = 0, 

where f l does not depend on the variable p v Thus we see that V <^ = and therefore p does 
not depend on the variable q l either. By the first equation in (4.36) we now get 
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where f 2 does not depend on p 1 and q v By condition H2 we see that V p ip = and hence / 
does not depend on p 2 . Iterating the above procedure we find that the only solutions of (4.36) 
are the constant functions. This concludes the proof of Theorem 4.8. 

Corollary 4.9. The stationary state n = ^t l ,t r produces a non-vanishing mean heat flux 
in the direction from the hotter to the colder reservoir. The mean heat flux vanishes only if 
T L =T R . 

Proof. The entropy production a is given by 

where <J> L is the energy flow from the left heat bath to the chain and similarly for <J> R . In the 
stationary state we have, by (4.7), 

and therefore 

<*L>„ = -< $ R>M- 

We obtain from Theorem 4.8, for T L ^ T R : 




If, say, T L > T R , we get (<£> L ) M > and thus energy flows from the hotter to the cooler heat 
bath. 
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